Model Checking and Strategy Synthesis for Stochastic Games: From Theory to Practice
نویسنده
چکیده
Probabilistic model checking is an automatic procedure for establishing if a desired property holds in a probabilistic model, aimed at verifying quantitative probabilistic specifications such as the probability of a critical failure occurring or expected time to termination. Much progress has been made in recent years in algorithms, tools and applications of probabilistic model checking, as exemplified by the probabilistic model checker PRISM (http://www. prismmodelchecker.org). However, the unstoppable rise of autonomous systems, from robotic assistants to self-driving cars, is placing greater and greater demands on quantitative modelling and verification technologies. To address the challenges of autonomy we need to consider collaborative, competitive and adversarial behaviour, which is naturally modelled using gametheoretic abstractions, enhanced with stochasticity arising from randomisation and uncertainty. This paper gives an overview of quantitative verification and strategy synthesis techniques developed for turn-based stochastic multi-player games, summarising recent advances concerning multi-objective properties and compositional strategy synthesis. The techniques have been implemented in the PRISM-games model checker built as an extension of PRISM. 1998 ACM Subject Classification F.3.1 Specifying and Verifying and Reasoning about Programs. D.2.4 Software/Program Verification
منابع مشابه
Attracting Tangles to Solve Parity Games
Parity games have important practical applications in formal verification and synthesis, especially to solve the model-checking problem of the modal mu-calculus. They are also interesting from the theory perspective, because they are widely believed to admit a polynomial solution, but so far no such algorithm is known. We propose a new algorithm to solve parity games based on learning tangles, ...
متن کاملPRISM-games: A Model Checker for Stochastic Multi-Player Games
We present PRISM-games, a model checker for stochastic multi-player games, which supports modelling, automated verification and strategy synthesis for probabilistic systems with competitive or cooperative behaviour. Models are described in a probabilistic extension of the Reactive Modules language and properties are expressed using rPATL, which extends the well-known logic ATL with operators to...
متن کاملStochastic Games: A Tutorial
Game theory [1] is a formalism for the study of competitive interaction in the rich spectrum of relationships ranging between conflict and cooperation. Originally conceived as a mathematical foundation of economics, it proved its robustness by providing new techniques and insights in logic and set theory [15, 13], evolutionary and population biology [22], auction design and implementation, the ...
متن کاملA Model for Developing the Best Strategy Combination Based on Balanced Scorecard, Fuzzy Net Present Value and Game Theory
Increasing competition has caused that organizations using evaluation, control and performance improvement try to maintain their supremacy in global markets. Balanced Scorecard model is one of the ways that can help organizations achieve this goal. In this study, the limitations of selecting performance criteria and executive strategies in balanced scorecard are discussed and two tools of curre...
متن کاملNew Algorithms for Solving Simple Stochastic Games
We present new algorithms for determining optimal strategies for two-player games with probabilistic moves and reachability winning conditions. Such games, known as simple stochastic games, were extensively studied by A.Condon [2,3]. Many interesting problems, including parity games and hence also mu-calculus model checking, can be reduced to simple stochastic games. It is an open problem, whet...
متن کامل